K (7T73(ty 



(19) 



(12) 



(43) Date of publication: 

04.03.1998 Bulletin 1998/10 

(21 ) Application number: 971 14621 .2 

(22) Date of filing: 25.08.1 997 



Europaisches Patentamt 
European Patent Office 
Office europeen des brevets (11) EP 0 827 129 A2 

EUROPEAN PATENT APPLICATION 

(51) int. Cl. 6 : G09G 3/34 



(84) Designated Contracting States: 


(72) Inventor: Kunzman, Adam J. 


AT BE CH DE OK ES R FR GB GR IE IT LI LU MC 


McKinney, Texas 75069 (US) 


NL PT SE 


(74) Representative: Holt, Michael 


(30) Priority: 30.08.1996 US 24923 P 


Texas Instruments Limited, 


(71) Applicant: 


Kempton Point, 


68 Staines Road West 


TEXAS INSTRUMENTS -INCORPORATED 


Sunbury-on-Thames, Middlesex TW16 7 AX (GB) 


Dallas, Texas 75243 (US) 





(54) Formatting and storing data for display systems using spatial light modulators 



(57) A formatter and frame buffer unit (20) for a dis- 
play system (10) that uses a spatial light modulator (16) 
to display data formatted in bit-planes. Formatters (21) 
convert multi-bit pixel data to bit-plane data. The frame 
buffer memory (25) is comprised of conventional DRAM 
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devices. To allow the use of DRAMs, formatters (21) 
operate on a number of consecutive pixels, the number 
of pixels being sufficient for an extended page mode 
form of addressing the DRAMs. 
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Description 
' TECHNICAL FIELD OF THE INVENTION 

5 The present invention relates generally to display systems that use spatial light modulators, and more particularly, 

" to formatting and storing data for delivery to the spatiaJ light modulator. 

BACKGROUND OF THE INVENTION 

iff. Video display systems based on spatial light modulators (SLMs) are increasingly being used as an alternative to 
display systems using cathode ray tubes (CRTs). SLM systems provide high resolution displays without the bulk and 
power consumption of CRT systems. 
« . Digital micro-mirror devices (DMDs) are a type of SLM. and may be used for projection display applications. The 
images provided by a DMD compare favorably with those provided by CRTs and can be projected to a screen in dimen- 

is sions surpassing today s-large screen televisions. 

A DMD has an array of micro-mechanical display elements, each having a tiny mirror that is individually addressa- 
ble by an electronic signal. Depending on the state of its addressing signal, each mirror tilts so that it either does or does 
not reflect light to the image plane, thereby modulating light incident on the DMD. The mirrors may be generally referred 
to as "display elements", which correspond to the pixels of the image that they generate. Generally, displaying pixel data 

20 is accomplished by loading memory cells connected to the display elements. Each memory cell receives one bit of data 
representing an "ON " or "OFF" state of the display. The display elements can maintain their "ON" or "OFF" state for 
controlled display times. 

Other SLMs operate on similar principles, with an array of display elements that may emit or reflect light simultane- 
ously, such that a complete image is generated by addressing display elements rather than by scanning a screen. 

25 Another example of an SLM is a liquid crystal display (LCD) having individually driven display elements. 

For all types of SLMs. motion displays are achieved by updating the data in the SLM's memory cells at sufficiently 
fast rates. To achieve intermediate levels of illumination, between white (ON) and black (OFF), pulse- width modulation 
(PWM) techniques are used. The basic PWM scheme involves first determining the rate at which images are to be pre- 
sented to the viewer. This establishes a frame rate and a corresponding frame period. For example, if images are dis- 

30 played 60 frames per second, each frame lasts for approximately 16.7 milliseconds. Then, the intensity resolution for 
each pixel is established. In a simple example, and assuming n bits of resolution, the frame time is divided into 2 n -1 
equal time slices. For a 16.7 millisecond frame period and n-bit intensity values, the time slice is 16.7/(2 n -1) millisec- 
onds. 

Having established these times, for each pixel of each frame, pixel intensities are quantized, such that black is 0 
35 time slices, the intensity level represented by the LSB is 1 time slice, and maximum brightness is 2 n -1 time slices. Each 
pixel's quantized intensity determines its on-time during a frame period. Thus, during a frame period, each pixel with a 
quantized value of more than 0 is "ON" for the number of time slices that correspond to its intensity. The viewer's eye 
integrates the pixel brightness so that the image appears the same as if it were generated with analog levels of light. 
For addressing SLMs. PWM calls for the data to be formatted into "bit-planes", each bit-plane corresponding to a 
40 bit weight of the intensity value. Thus, if each pixel's intensity is represented by an n-bit value, each frame of data has 
n bit -planes. -Each bit -plane has a 0 or 1 value for each display element. In the PWM example described in the preced- 
ing paragraphs, during a frame, each bit-plane is separately loaded and the display elements are addressed according 
to their associated bit-plane values. For example, the bit-plane representing the LSBs of each pixel is displayed for 1 
time slice, whereas the bit-plane representing the MSBs is displayed for 2n/2 time slices. 
45 Existing memories for storing data for delivery to the SLM have special purpose architectures. VRAM (video RAM) 
devices are row-addressable and can be combined with external logic for formatting. DM DRAM devices are ASICs hav- 
ing both data storage and format capability. An example of a DMD RAM is described in Published European Patent doc- 
ument No. 0.709,822, entitled "Memory Architecture for Reformatting and Storing Display Data in Standard TV and 
HDTV Systems", assigned to Texas Instruments Incorporated. 

so 

SUMMARY OF THE INVENTION 

One aspect of the invention is a format and frame buffer unit operable to deliver bit-plane data to a spatial light mod- 
ulator. A pair of formatters convert pixel data into bit-plane data. More specifically, each formatter receives multi-bit pixel 
55 data for N number of pixels and outputs N bits of the same weight. The formatters operate in a "double buffer" mode, in 
that one outputs the N number of bits while the other formatter receives a next N number of pixels. A first multiplexer 
selects between outputs of the two formatters, and a second multiplexer divides the N number of bits into bit-plane 
words. A DRAM controller converts the bit-plane words into the proper size for input to the frame buffer, and controls 
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memory addressing. The frame buffer is comprised of a pair of ORAM memories, which also operate in a "double buffer- 
mode. Each memory has a number of pages, each page having a size determined by a memory input word size times 
a number of columns. Thus, each memory is addressable by specifying a page and a column. The memory input word 
size is determined by a desired data rate and by the size of N, where N is sufficiently targe such that extended page 
5 mode addressing can be used to write the N number of bits to different columns of the same page. 

An advantage of the invention is that it permits frame buffer memories for spatial light modulators to be based on 
conventional DRAM memory chips. This reduces costs and permits efficient use of DRAMs for varying display resolu- 
tions and pixel resolutions. It also permits the spatial light modulator to be addressed with finer granularity - blocks of 
rows can be accessed whereas other methods permit access only on a row-by-row basts. 

*. 1° 

BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will now be further described, by way of example, with reference to the accompanying draw- 
ings in which: 

75 

FIGURE 1 is a block diagram of a projection display system, which uses a spatial light modulator to generate full- 
color full-motion displays, and which has a format and frame buffer unit in accordance with the invention; 

FIGURE 2 is a block diagram of the format and frame buffer unit of FIGURE 1 ; 

20 

FIGURE 3 illustrates one embodiment of the DRAMs of FIGURE 2; and 

FIGURE 4 illustrates an alternative embodiment of the DRAMs of FIGURE 2. 

25 DETAILED DESCRIPTION OF THE INVENTION 

FIGURE 1 is a block diagram of a projection display system 10, which uses a spatial light modulator (SLM) 16 to 
generate full-motion images from a YUV or an RGB video signal. Only those components significant to main-screen 
pixel data processing are shown. Other components, such as might be used for processing synchronization and audio 

30 signals or secondary screen features, such as closed captioning, are not shown. 

For purposes of this description, system 10 has a DMD-type SLM 16. Comprehensive descriptions of DMD-based 
digital display systems, without features of the present invention, are set out in U.S. Patent No. 5.079.544, entitled 
"Standard Independent Digitized Video System", in U.S. Patent No. 5.526,051. entitled "Digital Television System", and 
in U.S. Patent No. 5,452,024, entitled "DMD Display System." Each of these patents and patent applications is assigned 

35 to Texas Instruments Incorporated. System 10 could also be used with other types of SLMs that have operating char- 
acteristics similar to DMDs. notably, the use of bit-plane data. 

System 10 is capable of receiving input signals from a variety of sources. The input may be analog, resulting in YUV 
or RGB data, or digital, resulting in RGB data. Each type of data has its own front-end data path, comprised of a signal 
interface 12 or 12a and a processing unit 13 or 13a. 

40 Referring to the specific components of FIGURE 1 , analog interface 12 receives an analog video signal, such as 
an NTSC PAL, SECAM, or 4.43 NTSC signal. These signals arrive as interlaced fields, with alternating fields of even 
rows and odd rows. Each of these signals results in color difference (YUV) data. As indicated in FIGURE 1 , it is also 
possible that the analog input signal could be an RGB signal, resulting in RGB data. In this case, the analog interface 
12 would provide RGB data to RGB-data processing unit 13a rather than to YUV processing unit 13. 

45 Analog interface 12 detects the type of input signal, and delivers a control signal to timing unit 19 to indicate the 
field rate, line rate, and sample rate. It also delivers a control signal to YUV-data processing unit 1 3 (for YUV data) or to 
RGB-data processing unit 15 (for RGB data), for selecting the appropriate processing for that type of signal. Analog 
interface 12 separates video, synchronization, and audio signals. It includes components for A/D conversion and Y/UV 
separation, by which the signal is converted to pixel -data samples and the luminance ("Y") data is separated from the 

so chrominance ("UV") data. The signal may be converted to digital data before Y/UV separation, or Y/UV separation could 
be performed before A/D conversion. Regardless of the order of Y/UV separation and A/D conversion, the output is 
referred to herein as "YUV data" and is comprised of data representing luminance and chrominance information. 

YUV-data processing unit 13 prepares the YUV data for display, by performing various data processing tasks. 
Processing unit 1 3 may include whatever processing memory is useful for such tasks, such as field and line buffers. The 

55 tasks performed by processing unit 1 3 include conversion from interlaced to progressive scan format (proscan), scaling, 
and sharpness control. Interlaced to progressive scan conversion operates on interlaced fields of input data, and gen- 
erates new data to fill in odd lines of even fields and even lines of odd fields. Scaling is the process of changing image 
resolution, with horizontal scaling changing the number of active pixels per line and vertical scaling changing the 
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number of active lines per frame. 

If the input signal is digital data, a digital interface 12a receives the data and detects the type of input signal. It deliv- 
ers a control signal to timing unit 1 9 indicating the frame rate and horizontal and vertical resolution, as well as a control 
signal to RGB-data processing unit 13a to select the appropriate processing. It also performs whatever buffering and 
5 timing tasks are needed to prepare the data for processing. This data is assumed to be progressively scanned RGB 
• data, such as are the VGA and SVGA formats. 

RGB-data processing unit 13a receives RGB data from either analog interface 12 or digital interface 12a. It pre- 
pares the RGB data for display, and may include whatever processing memory is useful for such tasks, such as field 
and line buffers. The tasks performed by RGB-data processing unit 13a include scaling, sharpness control, and aper- 
ftf ture correction. 

Picture quality unit 14 performs tasks such as color space conversion and de-gamma. Colorspace conversion con- 
verts Y/C data to RGB data. De-gamma undoes gamma correction in signals intended for CRT displays and is required. 
. because unlike CRTs, DMDs are linear displays with no inherent gamma characteristics. 

The format and frame buffer unit 15 receives processed pixel data from picture quality unit 14. It formats the data 
is into "bit-plane" format, and delivers the bit-planes to SLM 16. The bit-planes for each color are delivered during one 
third of the total frame time, which corresponds to a one-third revolution of the color wheel. As discussed in the Back- 
ground, the bit-plane format permits each display element of SLM 16 to be turned on or off in response to the value of 
1 bit of data at a time. The structure and operation of format and frame buffer unit 1 5 is further explained below in con- 
nection with FIGURES 2-4. 

20 The bit-plane data from format and frame buffer unit 1 5 is delivered to SLM 1 6. Details of a suitable SLM 1 6 are set 
out in U.S. Patent No. 4,956,619, entitled "Spatial Light Modulator", which is assigned to Texas Instruments Incorpo- 
rated. Essentially, SLM 16 uses the data from the format and frame buffer unit 15 to address each display element of 
its display element array. The "ON" or "OFF" state of each display element forms an image. The data for different colors 
(red, green, and blue) is sequentially used to display three images through the color wheel 1 7. The eye adds the colors 

25 displayed (or not displayed) for each pixel and perceives the desired colors. 

Display optics unit 18 has optical components for illuminating SLM 16 and for projecting the image from SLM 16. 
In other embodiments, system 10 may have three SLMs instead of a single SLM 16, and no color wheel. The three 
SLMs would each concurrently generate an image of a different color -- red, green, and blue -- with the images com- 
bined for a full color display 

30 Master timing unit 19 provides various system control functions. Timing unit 19 may be implemented with a field 
programmable gate array (FPGA), to handle different frame resolutions and frame rates. As stated above, it receives a 
control signal from analog interface 12 or from digital interface 12a indicating the type of input signal, so that a corre- 
sponding frame rate, line rate, and sample rate (if analog) can be selected. 

FIGURE 2 illustrates format and frame buffer unit 15 in further detail. It is comprised of two formatters 21 , two mul- 

35 tiplexers 22 and 23, a DRAM controller 24. two DRAM memories 25. and an SLM interface 26. A feature of the invention 
is that the DRAM memories are comprised of conventional DRAM (dynamic random access memory) devices. 

In FIGURE 2, for purposes of example, bus widths and multiplexer sizes are explicitly included. However, it should 
be understood that these specifications may vary with different systems. 

Formatters 21 operate in a "double buffer" mode, that is, they take turns receiving and outputting data. In the exam- 

40 pie of this description, where system 10 has a single SLM 16 and a color wheel 1 7, the multi-bit pixel data delivered to 
formatters 2,1 is 24-bit data, 8 bits each for red, green, and blue frames of data. As explained below, when one formatter 
21 is full, it delivers bit-plane data to a DRAM 25 while the multi-bit pixel data is clocked into the other formatter 21 . 

Each formatter 21 has a structure similar to that of a FIFO memory, except that the outputs are designed to select 
one bit of the pixels in formatter 21 at a time. This results in the bit-plane format. For example, each output might be 

45 connected to a tri-state buffer. All bits of any one pixel are tied together to a tri-state line, allowing any one bit to be out- 
put Other bit selection methods, such as multiplexers could be used. Various bit-selection implementations are 
described in Published European Patent Document No. 0.709,822, referenced above, in Published European Patent 
document No. 0.655.723. entitled "Digital Memory for Display System Using Spatial Light Modulator", and in U.S. Patent 
No. 5,255.100. entitled "Data Formatter with Orthogonal Input/Output and Spatial Reordering". All of these inventions 

so are assigned to Texas Instruments Incorporated. 

Formatters 21 each receive N number of pixels, and as explained below, N is sufficiently large to write multiple col- 
umns of a DRAM 25. As explained below, this feature p -rmits the data rate necessary to fill the SLM 16 with data for a 
desired display resolution (number of pixels per line anc umber of lines), pixel resolution (number of bits per pixel), and 
frame rate. 

55 In the example of this description, formatters 21 each receive 256 pixels. Thus, N = 256. This capacity may also be 
referred to as the "pixel depth" of a formatter 21 . The pixel depth may vary to some extent with the configuration of sys- 
tem 10. More specifically, the pixel depth may be increased or decreased in accordance with varying SLM resolutions. 
However, as stated above, the pixel depth must be sufficient to fill multiple columns of a DRAM 25. 
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A first multiplexer 22 selects outputs from one or the other of formatters 21 . In the example of this description, there 
are 256 mux elements in multiplexer 22, each element receiving an output from one formatter 21 and an output from 
the other formatter 21 . 

A second multiplexer 23 divides the N-bit output of formatters 21 into words. In the example of this description, 
5 there are 16 mux elements in multiplexer 23, which divides the 256-bit output of formatters 21 to 1 6-bit words. The out- 
put of multiplexer 23 is referred to herein as "bit-plane words". In this example, each bit-plane word has one bit from 
each of 1 6 pixels, with all of the 1 6 bits belonging to the same bit-plane. For example, the 1 6 bits might all be the least 
significant bit of red data. 

ORAM controller 24 has various functions, including the addressing of DRAMs 25. As explained below, this 

io addressing is extended page mode addressing, where multiple columns of the same page of memory can be written 
without generating a page address for each column. If necessary. DRAM controller 24 also groups the bit-plane words 
from multiplexers 23 into properly sized memory input words. In the example of this description, DRAM controller 24 
groups every three bit-plane words to create 48-bit memory input words. In other embodiments, the bit-plane word size 
delivered to DRAM controller 24 might already match the memory input word size. 

is FIGURE 3 illustrates one of the D RAMs 25 of FIGURE 2. Consistent with the example specifications of FIGURE 2, 

DRAM 25 is configured for an 800 x 600 display on SLM 16 (800 pixels per row and 600 rows). Both DRAMs 25 have 
identical structure. They operate in a double buffer mode, so that DRAM 25 can receive a frame of data while the other 
DRAM 25 delivers a frame of data to SLM 16. 

As illustrated, DRAM 25 is comprised of 12 DRAM "chips" each 256K x 4 bits. The depth of each DRAM chip and 

20 the number of chips provide a certain memory input word size. In the example of FIGURE 3. where there are 12 chips 
each having a 4-bit depth, the memory input word size is 48 bits. The total size of DRAM 25 is in terms of "pages", 
where each page has a size determined by the memory input word size times a number of columns. For a DRAM 25 
comprised of 256K x 4 bit chips, there are 256 columns. Where the memory input word size is 48 bits, each page is 256 
x 48 bits. DRAM 25 has 1024 pages. 

25 Each bit-plane is stored in an associated number of pages. In the example of this description, each bit-plane is 
stored in 40 pages. For a frame of data (24 bit-planes). 960 pages are used (24 bit-planes x 40 pages per bit-plane). 

Referring to both FIGURE 2 and FIGURE 3, the length of each formatter 21 is sufficient to provide N consecutive 
bits of the same bit weight These N bits are read into DRAM 25 in sequence. Where the 256 bits have been divided 
into 48-bit words, 6 words are used to read in these 256 bits (some bits are unused). 

30 Because each 256 bits of data are for the same bit-plane, the 6 words containing these 256 bits can be written to 
the same page. For each of these words, the page address is the same and only a new column address need be gen- 
erated. In other words, multiple write cycles can occur without requiring a new page address to be generated. This 
mode of addressing is referred to herein as "extended page mode addressing" and reduces the time required for writing 
data into the memory. For example, for each write cycle, instead of requiring 60 ns to generate a page and a column 

35 address, only 30 ns might be required to generate the column address. 

In this example of extended page mode addressing, for bit-plane 0, a first word contains the first 48 values of bit 0 
for row 0 of SLM 1 8. The next 5 words contain the remaining values of the 256 pixels of row 0. These 6 words use the 
same page address and different column addresses. 

The next 256 bits will contain data for a new bit-plane. Thus, for the next 6 memory input words, a new page 

40 address is generated. However, the same page address can be used for these 6 words. 

This v process of writing each bit-plane for 256 pixels continues until the data for all 256 pixels is written into a DRAM 
25. Then data for a next 256 pixels is written in. The writing process switches between formatters 21 , each providing 
data for a next 256 pixels, until the DRAM 25 has received an entire frame of data. 

In practice, the memory input word size and the length of formatters 21 are determined by first calculating a desired 

45 data rate for data from DRAMs 25 into SLM 16. This data rate is based on the desired resolution, frame rate, and 
number of bit-plane loads per frame. It is assumed that the data written into DRAMs 25 must keep up with the data 
being read out. 

In the example of this description, a data rate of 900 Gbits per second is desired to provide an 800 x 600 display 
for a color wheel system, where all three colors must be displayed within a 60 frame per second frame rate. There are 
so to be 10 bit-plane loads per frame (some of the bit-planes are loaded more than once and displayed a portion of their 
display time on each load). 

From the data rate, the required DRAM bus width can be calculated. In accordance with the extended page mode 
writing described above, access times for this mode are assumed. In this example, an extended page mode access 
time of 30 ns is assumed. For example, a memory chip having only 30 ns access times might run at 33 MHz per pin, 
55 whereas a chip requiring 60 ns access times could run only half as fast. The true memory speed can be calculated for 
a particular length of formatters 21 . which reduce to 30 ns a certain number of access times that would otherwise be 
60 ns. The desired data rate can be divided by the memory speed to determine the number of output pins required. In 
the above example, these calculations result in a desired bus width of 48 bits (12 chips x 4 pins per chip). 
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FIGURE 4 illustrates another example of a DRAM 25 configured for a display system having three SLMs 16. As 
described above in connection with FIGURE 1 . each SLM • displays an image of a different color (red, green, or blue) 
- and the three images are corr^ - - j, green, anc a data follows three different data paths for delivery to a 

different SLM 16. In such a sys:.? ..id be three for mat and frame buffer units 15. one for each data path. Each 

5 unit 15 would have a structure like that of f " J RE 2. Thus, in FIGURE 4. DRAM 25 represents one of six DRAMs 25, 
* two for each color. 

The DRAM 25 of FIGURE 4 is configured for an SLM 1 6 having an 800 x 600 resolution, it can store up to 1 7 bit- 
planes. The memory input word size is 32 bits. It is assumed lhat formatters 21 each have a 256 pixel depth. Thus. 256 
bits of consecutive bit-plane data is delivered to DRAM 25. This permits 3 words to be written to a given page address, 
ior. with only addresses for 8 new columns being required. In other words, for these 8 memory input words, only one page 
address need be generated. Other than differences resulting from the different memory input word size, the writing of 
data to DRAMs 25 is the same as described above. 

The following tables illustrate how memory input word sizes may be calculated for other configurations of system 
10. As in the examples described above, an extended page mode access time of 30 ns is assumed. The "realizable bus 
is width" assumes the availability of DRAM chips having input word sizes of 4 bits, which chips are combined as in the 
above examples to provide memory input word sizes that are multiples of 4. The pixel depth of formatters 21 (the value 
of N) is a function of the time available for memory accesses during each frame. 



20 


Video Area 


Frame Rate 


Bit-plane loads 


Serial Data Rate (Mhz) 
32/16 col/line 


Bit-Rate 




640 x 480 


60 Hz 


30 


27/13 


553 Mbits/sec 






190 Hz 


10 


28/14 


567 Gbits/sec 


25 


800 x 600 


60 Hz 


30 


32/16 


864 Mbits/sec 






190 Hz 


10 


33/17 


900 Gbits/sec 




1280 x 768 


60 Hz 


30 


44/22 


1 .7 Gbits/sec 


30 




190 Hz 


10 


48/24 


1 .9 Gbits/sec 




Video Area 


Frame Rate 


DMD bus-width 


DRAM width 


Realizable bus-width 




640x480 


60 Hz 


20/10 


17 


20 






190 Hz 


20/10 


18 


20 


35 


800 x 600 


60 Hz 


54/27 


27 


28 






190 Hz 


54/27 


28 


28 




1280 x 768 


60 Hz 


80/40 


52 


60 


40 




190 Hz 


80/40 


58 


60 



Although the invention has been described with reference to specific embodiments, this description is not meant to 
be construed in a limiting sense. Various modifications of the disclosed embodiments, as well as alternative embodi- 
45 ments. will be apparent to persons skilled in the art. 

Claims 

1 . An apparatus for delivering bit-plane data to a spatial light modulator, comprising: 

50 

a plurality of formatters, each formatter receiving multi-bit pixel data for N pixels, such that one said formatter 
is operable to output N bits of the same weight while another of said formatters is operable to receive a next N 
pixels; 

a first multiplexer operable to select between outputs of said plurality of formatters; 
55 a second multiplexer operable to divide said N bits into bit-plane words; 

a plurality of frame buffer memories, operable to receive bit-plane words, each of said memories having a size 
determined in terms of a number of pages, each page having a size determined by a memory input word size 
times a number of columns, such that each of said memories is addressable by pages and columns; 
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wherein said memory input word size is determined by a desired data rate, and wherein N is a multiple 
of said input word size and is sufficiently large that a number of said columns in the same one of said pages 
can be written with said N bits; and 

a controller for providing addresses for said pages and columns. 

2. The apparatus of Claim 1 , wherein said second multiplexer provides bit-plane words of the same size as received 
by said frame buffer memories. 

3. The apparatus unit of Claim 1 , wherein said second multiplexer provides bit-plane words of a different size as 
received by said frame buffer memories, and wherein said controller conforms said bit-plane word sizes. 

4. The apparatus unit of any preceding Claim 1 , wherein said formatters output said N bits by multiplexing the bits of 
each of said pixels. 

5. The apparatus of any preceding claim, wherein each of said plurality of frame buffer memories comprises one or 
more dynamic random access memory (DRAM) devices. 

6. The apparatus of any preceding claim, wherein said apparatus is comprised of a format/buffer unit. 

7. A method of operating a frame buffer to deliver bit-plane data to a spatial light modulator, comprising the steps of: 

formatting multi-bit pixel data for N pixels, thereby providing N bits of the same weight before formatting a next 
N pixels; and 

writing said N number of bits to a frame buffer memory, said memory having a size determined in terms of a 
number of pages, each page having a size determined by a memory input word size times a number of col- 
■ umns, such that said memory is addressable by pages and columns; and 

wherein said memory input word size is determined by a desired data rate, and wherein N is a multiple 
of said memory input word size and is sufficiently large such that said writing step can be performed by writing 
to a number of said columns in the same page. 

8. The method of Claim 7, further comprising performing said formatting step with double buffered memory devices. 

9; The method of Claim 7 or Claim 8, further comprising performing said writing step with double buffered memory 
devices. 



' 08271 29A2_I_: 



7 



EPO 827 129 A2 



oo 



to 



CO 



cO 




3 


f 
















CO 




o 




1 — 




Q_ 




O 






i — 





ce 
o 
to 



i 








en 


cd 







CD ~; 



^ ^ £ 

- 3 ^ 

-< 

ZS ,CC ZD 

o 









L 


or 


o 


CQ 





ZD m 


1 — 






5z3 


ZD 


Q_ O 





cd - 



>- ZD 



on 



CD 



Q3 



cn 






-\ 


ce 


CD 




I 






AC 


zs 




2 





cd 



i 

C/l CO 



o 
1 A 



CD 

_ oo 
> oo 

ZD LJ 
>- CD 
O 
CC 

a. 



CD 



o 



o 

o 
a: 
q_ 



or cd an 



CD 



si - 

^ CD 
-< OO 



OC CD CD 





) 














* CD 


CD ^> 




O 



o 



rr 



CD 



5 

CD O 
Q CO 



CD 







ao 


Z5 




AM 


ce: 




or 


CD 




CD 




/ g- g \ 



CO 
CM 



Cvj 
CM 



/ \ 



CO 
cO 



CO 
cO 

CNI 



cc 

t_»J -f 

O 



CN 



-a- 

Cvl 



CO 



cn 
o 



cn 



cd 



BNSDOaCh <£P 08271 29A2_I_> 



8 



EP 0 827 129 A2 




EP 0 827 129 A2 




(19) 



J) 



(12) 



(88) Date of publication A3: 

11.08.1999 Bulletin 1999/32 

(43) Date of publication A2: 

04.03.1998 Bulletin 1998/10 

(21) Application number: 97114621.2 

(22) Date of filing: 25.08.1997 



Europaisches Patentamt 
European Patent Office 
Office europeen des brevets (11) EP 0 827 129 A3 

EUROPEAN PATENT APPLICATION 

(51) Intel. 6 : G09G 3/34 



(84) Designated Contracting States: 


(72) Inventor: Kunzman, Adam J. 


AT BE CH DE DK ES Fl FR GB GR IE IT LI LU MC 


McKInney, Texas 75069 (US) 


NL PT SE 






(74) Representative: Holt, Michael 


(30) Priority: 30.08.1996 US 24923 P 


Texas Instruments Limited, 




P.O. Box 5069 


(71) Applicant: 


Northampton NN4 7ZE (GB) 


TEXAS INSTRUMENTS INCORPORATED 




Dallas, Texas 75243 (US) 





(54) Formatting and storing data for display systems using spatial light modulators 



(57) A formatter and frame buffer unit (20) for a dis- 
play system (10) that uses a spatial light modulator (16) 
to display data formatted in bit-planes. Formatters (21) 
convert multi-bit pixel data to bit-plane data. The frame 
buffer memory (25) is comprised of conventional DRAM 



devices. To allow the use of DRAMs, formatters (21) 
operate on a number of consecutive pixels, the number 
of pixels being sufficient for an extended page mode 
form of addressing the DRAMs. 



2*. 



FIG. 2 



21 



N 



FORMATTER A 
Nx24 



2fy 



15^5 n A 



FORMATTER 8 
Nx24 



2:1 
x 

256 



2^ 



M2 



1&1 
t 

16 



ORAM 
CONTROLLER 

24 


48, 




ORAM A j 


' 25-^ 




ORAM 8 | j 







TO SIM 
15 



CO 
< 

CM 



CM 
CO 



GL 
LU 



Primed by Xanax (UK) Business Services 
2.16.7/aG 



BNSOOCIO: <BP 08271 29A3 I > 



EP 0 827 129 A3 



3 



European Patent 
Office 



EUROPEAN SEARCH REPORT 



Application Number 

EP 97 11 4621 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 



Citation of document with indication, where appropriate. 
of relevant passages 



Relevant 
to claim 



CLASSIFICATION OF THE 
APPLICATION <lnt.a.6) 



A,D 



D,A 



EP 0 530 760 A (TEXAS INSTRUMENTS INC) 
10 March 1993 

* column 8, line 55 - column 10, line 49 * 

* figure 5 * 

EP 0 689 345 A (TEXAS INSTRUMENTS INC) 
27 December 1995 

* page 4, line 53 - page 5, line 20 * 

* page 5, 1 ine 35 - 1 ine 44 * 

* figures 1-3 * 

W0 92 09064 A (RANK BR I MAR LTD) 
29 May 1992 

* page 15, line 30 - page 16, line 19 * 

* figure 14 * 

EP 0 709 822 A (TEXAS INSTRUMENTS INC) 
1 May 1996 

* column 6, line 27 - line 57 * 

* figure 5 * 

EP 0 530 759 A (TEXAS INSTRUMENTS INC) 
10 March 1993 

* the whole document * 



The present search report has been drawn up tor alt claims 



Place of saarcft 

THE HAGUE 



Dat* crt compteflon ait* - ..m 

18 June 1999 



1,7 



1,7 



G09G3/34 



1,7 



1,7 



1,7 



TECHNICAL FIELDS 
SEARCHED (lnt.Cl.8) 



G09G 



Earrlcella, L 



3 



CATEGORY OF CITED DOCUMENTS 

X : parti cm arty relevant * taken alon* 

Y : parfcuJarty relevant it combined wtth another 

document ot the same category 
A : technological background 
O : non-written disclosure 
P : intermediate document 



T : theory or pnncipw underlying the invention 
E ; eartter patent document, but pubfished on. or 

after the filing date 
O : document cited in the application 
L : document a ted for other reasons 



& : member ot the same patent family, corresponding 
document 



2 



BNSDCOD: <EP_0827129A3_I_> 



EP 0 827 129 A3 



ANNEX TO THE EUROPEAN SEARCH REPORT 

ON EUROPEAN PATENT APPLICATION NO. EP 97 11 4621 



This annex its is the patent famHy mem Ders relating to the patent documents cited in the aoove-mentioned European search report 
The members are as contained in the European Patent Office EDP file on 

The European Patent Office is in no way liable for these particulars which are merely given for the purpose of information. 

18-06-1999 



Patent document 
cited in search report 


Publication 
date 


Patent family 
member(s) 


Publication 
date 


tr U3JU/0U 


A 


10-03-1993 






A 








DE 


69215798 


D 


*5 1—fl 1 — 1 QQ7 

tj U-i iyy / 






0E 


69215798 


T 


10-04-1997 






JP 


5260422 


A 


08-10-1993 


EP 0689345 


A 


27-12-1995 


EP 


0689343 


A 








EP 


0689344 


A 


"57—1 "3 1 QflC 

_:/-i-_-iyyb 






CA 


2063744 


A 


AO— .1 f\ 1 QQO 






CN 


1068232 


A, 8 


■5n_.ni _ i qq *5 






CN 


1115935 


A 


jl-ui-iyyo 






CN 


1115936 


A 


ji u i iyyo 






DE 


69220998 


0 


f\A A<"1_ 1 flflT 

U4-uy-iyy / 






0E 


69220998 


T 


OO f\ 1 _ 1 OOQ 






tr 


U3U / c /u 


A 

A 


m in i oqo 

u/-iu-iyy,_ 






JP 


5183851 


A 


^j-ov-iyy o 






US 


5278652 


A 


11-01-1994 






US 


5339116 


A 


16-03-1994 






us 


5523803 


A 


uh-uo iyyo 






us 


5745193 


A 




WO 9209064 


A 


29-05-1992 


AT 


143552 


T 


1 :_in_i qq*; 
id lu iyyo 






al 1 


aonfizlQ 1 

OsUDH? 1 


a 

M 


1 1 —OA— 1 QQ9 






AU 


8906891 


A 


1 1 — flA-1 QQ? 






DE 


69122407 


D 


31-10-1996 






DE 


69122407 


T 


03-04-1997 






DK 


557360 


T 


1 QQ7 






cr 




a 

n 


m -HQ- 1 QQ** 






EP 


0557362 


A 








EP 


0707303 


A 


17-04-1996 






WO 


9209065 


A 


29-05-1992 






US 


5673060 


A 


30-09-1997 






us 


5686939 


A 


11-11-1997 


EP 0709822 


A 


01-05-1996 


us 


5680156 


A 


21-10-1997 






EP 


0709802 


A 


01-05-1996 






EP 


0713117 


A 


22-05-1996 






EP 


0710016 


A 


01-05-1996 






EP 


0710019 


A 


01-05-1996 






JP 


8265672 


A 


11-10-1996 






us 


5598188 


A 


28-01-1997 


EP 0530759 


A 


10-03-1993 


us 


5255100 


A 


19-10-1993 






DE 


69219700 


D 


19-06-1997 






DE 


69219700 


T 


13-11-1997 






JP 


5224644 


A 


03-09-1993 





S. For more details about this annex :see Official Journal of the European Patent Office. No. 12/82 



3 



BNSOOCID: <£P_08271 29A3 J_> 



This Page is Inserted by IFW Indexing and Scanning 
Operations and is not part of the Official Record 

BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of the original 
documents submitted by the applicant. 

Defects in the images include but are not limited to the items checked: 

□ BLACK BORDERS 

□ IMAGE CUT OFF AT TOP, BOTTOM OR SIDES 

□ FADED TEXT OR DRAWING 

□ BLURRED OR ILLEGIBLE TEXT OR DRAWING 

□ SKEWED/SLANTED IMAGES 

□ COLOR OR BLACK AND WHITE PHOTOGRAPHS 

□ GRAY SCALE DOCUMENTS 

□ LINES OR MARKS ON ORIGINAL DOCUMENT 

□ REFERENCE(S) OR EXHIBIT(S) SUBMITTED ARE POOR QUALITY 

□ OTHER: 

IMAGES ARE BEST AVAILABLE COPY. 
As rescanning these documents will not correct the image 
problems checked, please do not report these problems to 
the IFW Image Problem Mailbox. 



